Pandas Profiling Report

Dataset statistics

Number of variables	9
Number of observations	13129
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	923.3 KiB
Average record size in memory	72.0 B

Variable types

Numeric	9

Warnings

`track_id` has unique values	Unique
`danceability` has unique values	Unique
`energy` has unique values	Unique
`speechiness` has unique values	Unique

Reproduction

Analysis started	2021-02-20 09:41:57.671348
Analysis finished	2021-02-20 09:42:06.524729
Duration	8.85 seconds
Software version	pandas-profiling v2.10.1
Download configuration	config.yaml

track_id
Real number (ℝ_≥0)

UNIQUE

Distinct	13129
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	34031.05827
Minimum	2
Maximum	124911
Zeros	0
Zeros (%)	0.0%
Memory size	102.7 KiB

Quantile statistics

Minimum	2
5-th percentile	1609.4
Q1	12986
median	28097
Q3	45021
95-th percentile	105011.6
Maximum	124911
Range	124909
Interquartile range (IQR)	32035

Descriptive statistics

Standard deviation	28950.42218
Coefficient of variation (CV)	0.8507059038
Kurtosis	1.453502919
Mean	34031.05827
Median Absolute Deviation (MAD)	15740
Skewness	1.345293707
Sum	446793764
Variance	838126944.5
Monotocity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
8188	1	< 0.1%
39766	1	< 0.1%
41841	1	< 0.1%
23406	1	< 0.1%
64362	1	< 0.1%
93032	1	< 0.1%
7014	1	< 0.1%
33637	1	< 0.1%
15202	1	< 0.1%
11104	1	< 0.1%
Other values (13119)	13119	99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2	1	< 0.1%
3	1	< 0.1%
5	1	< 0.1%
10	1	< 0.1%
134	1	< 0.1%

Value	Count	Frequency (%)
124911	1	< 0.1%
124864	1	< 0.1%
124863	1	< 0.1%
124862	1	< 0.1%
124857	1	< 0.1%

acousticness
Real number (ℝ_≥0)

Distinct	12905
Distinct (%)	98.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.5246876457
Minimum	9.035 × 10⁷
Maximum	0.9957964501
Zeros	0
Zeros (%)	0.0%
Memory size	102.7 KiB

Quantile statistics

Minimum	9.035 × 10⁷
5-th percentile	0.00084733888
Q1	0.1037725546
median	0.5739848424
Q3	0.9207269763
95-th percentile	0.9949785144
Maximum	0.9957964501
Range	0.9957955466
Interquartile range (IQR)	0.8169544217

Descriptive statistics

Standard deviation	0.3837185744
Coefficient of variation (CV)	0.7313276337
Kurtosis	-1.61854111
Mean	0.5246876457
Median Absolute Deviation (MAD)	0.3836039422
Skewness	-0.1335961627
Sum	6888.624101
Variance	0.1472399443
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.9957964501	217	1.7%
0.9957614306	2	< 0.1%
0.9955603923	2	< 0.1%
0.9954670339	2	< 0.1%
0.9957699341	2	< 0.1%
0.995645799	2	< 0.1%
0.9956839584	2	< 0.1%
0.9956712757	2	< 0.1%
0.9956348347	2	< 0.1%
0.8450387364	1	< 0.1%
Other values (12895)	12895	98.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
9.035 × 10⁷	1	< 0.1%
9.491 × 10⁷	1	< 0.1%
9.575 × 10⁷	1	< 0.1%
1.0362 × 10⁶	1	< 0.1%
1.1568 × 10⁶	1	< 0.1%

Value	Count	Frequency (%)
0.9957964501	217	1.7%
0.9957961874	1	< 0.1%
0.9957960494	1	< 0.1%
0.9957871346	1	< 0.1%
0.9957855699	1	< 0.1%

danceability
Real number (ℝ_≥0)

UNIQUE

Distinct	13129
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.4872904971
Minimum	0.051307487
Maximum	0.9686446617
Zeros	0
Zeros (%)	0.0%
Memory size	102.7 KiB

Quantile statistics

Minimum	0.051307487
5-th percentile	0.1741972247
Q1	0.3447591127
median	0.485634814
Q3	0.6290940727
95-th percentile	0.7994442269
Maximum	0.9686446617
Range	0.9173371747
Interquartile range (IQR)	0.28433496

Descriptive statistics

Standard deviation	0.190148007
Coefficient of variation (CV)	0.3902148885
Kurtosis	-0.73490098
Mean	0.4872904971
Median Absolute Deviation (MAD)	0.1422164698
Skewness	0.02854011807
Sum	6397.636937
Variance	0.03615626456
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.5708422257	1	< 0.1%
0.6600311704	1	< 0.1%
0.3514178192	1	< 0.1%
0.6980759285	1	< 0.1%
0.825258179	1	< 0.1%
0.6245612467	1	< 0.1%
0.6555831112	1	< 0.1%
0.6513166156	1	< 0.1%
0.4033353164	1	< 0.1%
0.7216467633	1	< 0.1%
Other values (13119)	13119	99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.051307487	1	< 0.1%
0.0514351419	1	< 0.1%
0.051635747	1	< 0.1%
0.0516677127	1	< 0.1%
0.0528348797	1	< 0.1%

Value	Count	Frequency (%)
0.9686446617	1	< 0.1%
0.9668831644	1	< 0.1%
0.9618706942	1	< 0.1%
0.961547359	1	< 0.1%
0.9552394837	1	< 0.1%

energy
Real number (ℝ_≥0)

UNIQUE

Distinct	13129
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.5375155316
Minimum	2.01659 × 10⁵
Maximum	0.9999637108
Zeros	0
Zeros (%)	0.0%
Memory size	102.7 KiB

Quantile statistics

Minimum	2.01659 × 10⁵
5-th percentile	0.05641813316
Q1	0.3213003717
median	0.5491128455
Q3	0.7762541942
95-th percentile	0.9486446235
Maximum	0.9999637108
Range	0.9999435449
Interquartile range (IQR)	0.4549538225

Descriptive statistics

Standard deviation	0.2780488872
Coefficient of variation (CV)	0.5172853078
Kurtosis	-1.031884058
Mean	0.5375155316
Median Absolute Deviation (MAD)	0.2276580579
Skewness	-0.1925456384
Sum	7057.041414
Variance	0.07731118367
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.4804835205	1	< 0.1%
0.9243203596	1	< 0.1%
0.4964655061	1	< 0.1%
0.4530468049	1	< 0.1%
0.5591730514	1	< 0.1%
0.5698381794	1	< 0.1%
0.3980720163	1	< 0.1%
0.558457729	1	< 0.1%
0.9285970086	1	< 0.1%
0.1389475586	1	< 0.1%
Other values (13119)	13119	99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2.01659 × 10⁵	1	< 0.1%
2.02817 × 10⁵	1	< 0.1%
2.03071 × 10⁵	1	< 0.1%
2.03104 × 10⁵	1	< 0.1%
2.03357 × 10⁵	1	< 0.1%

Value	Count	Frequency (%)
0.9999637108	1	< 0.1%
0.9999504059	1	< 0.1%
0.9998821462	1	< 0.1%
0.999767599	1	< 0.1%
0.9997318043	1	< 0.1%

instrumentalness
Real number (ℝ_≥0)

Distinct	12969
Distinct (%)	98.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.6405359213
Minimum	0
Maximum	0.9980162209
Zeros	38
Zeros (%)	0.3%
Memory size	102.7 KiB

Quantile statistics

Minimum	0
5-th percentile	1.417644 × 10⁵
Q1	0.323466117
median	0.8381337604
Q3	0.9182439469
95-th percentile	0.9637844918
Maximum	0.9980162209
Range	0.9980162209
Interquartile range (IQR)	0.5947778299

Descriptive statistics

Standard deviation	0.3614301125
Coefficient of variation (CV)	0.5642620508
Kurtosis	-0.9161849462
Mean	0.6405359213
Median Absolute Deviation (MAD)	0.1087424846
Skewness	-0.8837819104
Sum	8409.596111
Variance	0.1306317263
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.9728700043	51	0.4%
0	38	0.3%
3 × 10¹⁰	12	0.1%
2 × 10¹⁰	9	0.1%
1 × 10¹⁰	9	0.1%
1 × 10⁹	7	0.1%
6 × 10¹⁰	5	< 0.1%
5 × 10¹⁰	4	< 0.1%
2.1 × 10⁹	4	< 0.1%
4 × 10¹⁰	4	< 0.1%
Other values (12959)	12986	98.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	38	0.3%
1 × 10¹⁰	9	0.1%
2 × 10¹⁰	9	0.1%
3 × 10¹⁰	12	0.1%
4 × 10¹⁰	4	< 0.1%

Value	Count	Frequency (%)
0.9980162209	1	< 0.1%
0.9971209445	1	< 0.1%
0.9931342795	1	< 0.1%
0.9910224474	1	< 0.1%
0.9910188457	1	< 0.1%

liveness
Real number (ℝ_≥0)

Distinct	13128
Distinct (%)	> 99.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.1878036461
Minimum	0.0252973415
Maximum	0.9803300006
Zeros	0
Zeros (%)	0.0%
Memory size	102.7 KiB

Quantile statistics

Minimum	0.0252973415
5-th percentile	0.07088730634
Q1	0.1014056421
median	0.1190017893
Q3	0.2110407548
95-th percentile	0.5661655007
Maximum	0.9803300006
Range	0.9550326591
Interquartile range (IQR)	0.1096351127

Descriptive statistics

Standard deviation	0.1580505933
Coefficient of variation (CV)	0.8415736148
Kurtosis	5.686617057
Mean	0.1878036461
Median Absolute Deviation (MAD)	0.0301656935
Skewness	2.340950399
Sum	2465.674069
Variance	0.02497999005
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.1115680163	2	< 0.1%
0.1116739413	1	< 0.1%
0.6084464532	1	< 0.1%
0.3848540692	1	< 0.1%
0.3377881337	1	< 0.1%
0.1458884972	1	< 0.1%
0.2896960734	1	< 0.1%
0.0792847179	1	< 0.1%
0.1114939944	1	< 0.1%
0.0858449424	1	< 0.1%
Other values (13118)	13118	99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.0252973415	1	< 0.1%
0.0259163824	1	< 0.1%
0.0262909903	1	< 0.1%
0.0265893657	1	< 0.1%
0.0270401333	1	< 0.1%

Value	Count	Frequency (%)
0.9803300006	1	< 0.1%
0.9719684723	1	< 0.1%
0.9713922939	1	< 0.1%
0.9709239308	1	< 0.1%
0.9700352953	1	< 0.1%

speechiness
Real number (ℝ_≥0)

UNIQUE

Distinct	13129
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.09917423838
Minimum	0.0223236675
Maximum	0.9661774074
Zeros	0
Zeros (%)	0.0%
Memory size	102.7 KiB

Quantile statistics

Minimum	0.0223236675
5-th percentile	0.02906533834
Q1	0.0369324895
median	0.049019219
Q3	0.0854524094
95-th percentile	0.3997288035
Maximum	0.9661774074
Range	0.9438537399
Interquartile range (IQR)	0.0485199199

Descriptive statistics

Standard deviation	0.1373805072
Coefficient of variation (CV)	1.385243884
Kurtosis	14.21318349
Mean	0.09917423838
Median Absolute Deviation (MAD)	0.0157842236
Skewness	3.535996513
Sum	1302.058576
Variance	0.01887340375
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.0396297376	1	< 0.1%
0.0659640985	1	< 0.1%
0.0505643926	1	< 0.1%
0.0372165593	1	< 0.1%
0.0540218717	1	< 0.1%
0.1072744313	1	< 0.1%
0.0561734659	1	< 0.1%
0.5663985889	1	< 0.1%
0.0376377752	1	< 0.1%
0.0396282571	1	< 0.1%
Other values (13119)	13119	99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.0223236675	1	< 0.1%
0.0226634426	1	< 0.1%
0.0227946731	1	< 0.1%
0.0228492047	1	< 0.1%
0.0230059863	1	< 0.1%

Value	Count	Frequency (%)
0.9661774074	1	< 0.1%
0.9643768937	1	< 0.1%
0.9640734603	1	< 0.1%
0.9630526925	1	< 0.1%
0.9604609803	1	< 0.1%

tempo
Real number (ℝ_≥0)

Distinct	11902
Distinct (%)	90.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	123.080061
Minimum	12.753
Maximum	251.072
Zeros	0
Zeros (%)	0.0%
Memory size	102.7 KiB

Quantile statistics

Minimum	12.753
5-th percentile	72.452
Q1	95.967
median	120.057
Q3	145.318
95-th percentile	185.7352
Maximum	251.072
Range	238.319
Interquartile range (IQR)	49.351

Descriptive statistics

Standard deviation	35.01513746
Coefficient of variation (CV)	0.2844907386
Kurtosis	0.04913710758
Mean	123.080061
Median Absolute Deviation (MAD)	24.723
Skewness	0.4515204074
Sum	1615918.121
Variance	1226.059851
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
120.007	7	0.1%
120.004	7	0.1%
100.01	6	< 0.1%
120.01	6	< 0.1%
120.028	6	< 0.1%
120.021	6	< 0.1%
129.99	5	< 0.1%
100.009	5	< 0.1%
120.006	5	< 0.1%
139.992	5	< 0.1%
Other values (11892)	13071	99.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
12.753	1	< 0.1%
19.659	1	< 0.1%
26.131	1	< 0.1%
27.493	1	< 0.1%
29.093	1	< 0.1%

Value	Count	Frequency (%)
251.072	1	< 0.1%
250.059	1	< 0.1%
249.616	1	< 0.1%
249.365	1	< 0.1%
247.791	1	< 0.1%

valence
Real number (ℝ_≥0)

Distinct	13127
Distinct (%)	> 99.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.4397607641
Minimum	1 × 10⁵
Maximum	0.99999
Zeros	0
Zeros (%)	0.0%
Memory size	102.7 KiB

Quantile statistics

Minimum	1 × 10⁵
5-th percentile	0.03947985412
Q1	0.1973211315
median	0.417742892
Q3	0.6655754057
95-th percentile	0.9168766766
Maximum	0.99999
Range	0.99998
Interquartile range (IQR)	0.4682542742

Descriptive statistics

Standard deviation	0.2760283032
Coefficient of variation (CV)	0.6276783326
Kurtosis	-1.092554418
Mean	0.4397607641
Median Absolute Deviation (MAD)	0.2328436598
Skewness	0.2329070118
Sum	5773.619072
Variance	0.07619162414
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.99999	3	< 0.1%
0.6206829623	1	< 0.1%
0.0842928514	1	< 0.1%
0.8653079911	1	< 0.1%
0.9236597086	1	< 0.1%
0.0397239056	1	< 0.1%
0.9640658439	1	< 0.1%
0.5030123299	1	< 0.1%
0.7995113292	1	< 0.1%
0.041869872	1	< 0.1%
Other values (13117)	13117	99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1 × 10⁵	1	< 0.1%
0.0022453715	1	< 0.1%
0.0086949409	1	< 0.1%
0.0090588496	1	< 0.1%
0.010527662	1	< 0.1%

Value	Count	Frequency (%)
0.99999	3	< 0.1%
0.9925827278	1	< 0.1%
0.9911322105	1	< 0.1%
0.9894383176	1	< 0.1%
0.9872669463	1	< 0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	track_id	acousticness	danceability	energy	instrumentalness	liveness	speechiness	tempo	valence
0	2	0.416675	0.675894	0.634476	0.010628	0.177647	0.159310	165.922	0.576661
1	3	0.374408	0.528643	0.817461	0.001851	0.105880	0.461818	126.957	0.269240
2	5	0.043567	0.745566	0.701470	0.000697	0.373143	0.124595	100.260	0.621661
3	10	0.951670	0.658179	0.924525	0.965427	0.115474	0.032985	111.562	0.963590
4	134	0.452217	0.513238	0.560410	0.019443	0.096567	0.525519	114.290	0.894072
5	139	0.106550	0.260911	0.607067	0.835087	0.223676	0.030569	196.961	0.160267
6	140	0.376312	0.734079	0.265685	0.669581	0.085995	0.039068	107.952	0.609991
7	141	0.963657	0.435933	0.075632	0.345493	0.105686	0.026658	33.477	0.163950
8	142	0.662881	0.379065	0.823856	0.910266	0.088705	0.079090	147.781	0.092868
9	144	0.909011	0.443643	0.641997	0.924092	0.267669	0.089659	128.537	0.788251

Last rows

	track_id	acousticness	danceability	energy	instrumentalness	liveness	speechiness	tempo	valence
13119	124852	0.702553	0.728900	0.590636	0.415060	0.118425	0.037389	100.000	0.198466
13120	124853	0.020307	0.689575	0.676306	0.891817	0.095915	0.030968	120.023	0.438201
13121	124854	0.026545	0.667363	0.657399	0.364107	0.108031	0.042832	121.004	0.460545
13122	124855	0.160281	0.604249	0.554242	0.728696	0.351249	0.175388	167.975	0.402043
13123	124856	0.112268	0.581255	0.665963	0.853041	0.100966	0.041647	121.010	0.387918
13124	124857	0.007592	0.790364	0.719288	0.853114	0.720715	0.082550	141.332	0.890461
13125	124862	0.041498	0.843077	0.536496	0.865151	0.547949	0.074001	101.975	0.476845
13126	124863	0.000124	0.609686	0.895136	0.846624	0.632903	0.051517	129.996	0.496667
13127	124864	0.327576	0.574426	0.548327	0.452867	0.075928	0.033388	142.009	0.569274
13128	124911	0.993606	0.499339	0.050622	0.945677	0.095965	0.065189	119.965	0.204652

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows